Automated guided vehicle systems for retrieving items

ABSTRACT

Systems, method, and computer-readable storage media for controlling item retrieval processes from an item and storage infrastructure are disclosed. The disclosed techniques utilize an automated guided vehicle (AGV) and real-time feedback to validate the item retrieval process is performed correctly. Item retrieval may be performed autonomously by an AGV equipped with item retrieval components, such as hydraulic arms, pistons, and other components and control logic, or may be performed as a user-aided process, where feedback is provided to the user to instruct the user which item is to be retrieved and the user then loads the item onto the AGV. The AGV is configured to utilize a coordinate system to facilitate automated navigation along a series of determined waypoints during the item retrieval process. Additionally feedback or instructions may be provided to a user device for user-aided processes) to assist with the item retrieval process.

TECHNICAL FIELD

The present application relates to industrial ergonomics and morespecifically to systems utilizing autonomous vehicles and machinelearning techniques to improve industrial processes.

BACKGROUND

Many types of industrial processes involve complex logistics problemsthat present challenges across a variety of systems and interfaces. Forexample, manufacturing processes often involve several differentcomputing systems, such as an enterprise resource planning (ERP) system,facility and inventory management systems, user interface applicationsthat facilitate user interaction with the ERP, facility, and inventorymanagement systems, and the like. These different systems may become outof sync resulting in system information becoming inaccurate, such ashaving incorrect inventory levels indicated in an inventory database orother information discrepancies. When such errors occur, manufacturingprocesses may he delayed or canceled unnecessarily. For example, ifinventory levels indicate that a particular item used in a manufacturingprocess is out of stock but there actually is sufficient stock on hand,additional quantities of the item may be ordered, and the manufacturingprocess may be scheduled for completion at a later time when the newlyordered item(s) will arrive. Such discrepancies also often requireextraneous tasks to he performed, such as periodic inventory audits,where one or more individuals manually inspect inventory levels toverify the accuracy of records stored in the inventory database(s). Suchaudits are time consuming and inefficient, as production may need to beslowed in order to manually count current inventory for each item whilethe audit takes place.

SUMMARY

The present application is directed to techniques for improvingmanufacturing processes and infrastructure that support themanufacturing processes. In embodiments, an automated guided vehicle(AGV) is provided with capabilities to autonomously navigate item andstorage infrastructure, such as a warehouse or other facility whereitems used in man till taming processes are stored, to retrieve itemsand deliver the items to a manufacturing/assembly area where the itemsare consumed by the manufacturing/assembly process. The AGV isconfigured to utilize a coordinate system calibrated to enableautonomous navigation of the AGV within the item and storageinfrastructure to retrieve items needed by manufacturing processes andto travel from the item and storage infrastructure to amanufacturing/assembly area once an amount of items have been correctlyretrieved and loaded onto the AGV. In some aspects, the items may bemanually loaded on the AGV by a user while in other aspects the itemretrieval process may be completely automated by an AGV having itemretrieval components (e.g., mechanical anus, hydraulics, controlelements, and the like) that enable the AGV to automatically retrieveitems for delivery to the manufacturing/assembly area.

The AGVs may be supported by one or more servers or a cloud-basedinfrastructure that utilizes machine learning algorithms to select itemsand storage infrastructure and a particular AGV that are to be utilizedto perform item retrieval in a timely manner such that items required bya manufacturing process are delivered at or near the time at which themanufacturing process is ready for the items. The AGVs and supportingsystems are equipped with functionality to validate item retrieval isperformed correctly and update inventory records at one or moredatabases to reflect. current on-hand quantities as items are consumedby the manufacturing/assembly processes. Additionally, the supportinginfrastructure (e.g., servers or cloud-based resources) may beconfigured to monitor the inventory database(s) and customer demand toautomatically place orders for additional inventory so that on handquantities of items are maintained at sufficient levels to ensurecontinuous operation of the manufacturing processes

During user-aided item retrieval operations, the AGVs and supportinginfrastructure may provide real-time feedback to users to indicate theitems to be retrieved, as well as to indicate where retrieved itemsshould be placed on the AGV. The real-time feedback is configured tominimize errors during item retrieval operations so as to minimizeinstances where incorrect items are delivered to themanufacturing/assembly processes. In addition to providing real-timefeedback, the AGV or the AGV in connection with the supportinginfrastructure may be configured to validate item retrieval based onsensor data provided by the AGV. Where the sensor data and validationprocessing indicate that an incorrect item has been retrieved, or that acorrect item has been incorrectly loaded onto the AGV, additionalfeedback may be provided to the user. Feedback may also be provided tothe user in the form of one or more interactive graphical userinterfaces providing functionality that operate in coordination with theAGV and supporting infrastructure to guide the item retrieval process.

The foregoing has outlined rather broadly the features and technicaladvantages of the present invention in order that the detaileddescription of the invention that follows may be bettor understood.Additional features and advantages of the invention will be describedhereinafter which faun the subject of the claims of the invention. Itshould be appreciated by those skilled in the art that the conceptionand specific embodiment disclosed may be readily utilized as a basis formodifying or designing, other structures for carrying out the samepurposes of the present invention. It should also be realized by thoseskilled in the art that such equivalent constructions do not depart fromthe spirit and scope of the invention as set forth in the appendedclaims. The novel features which are believed to be characteristic ofthe invention, both as to its organization and method of operation,together with further objects and advantages will be better understoodfrom the following description when considered in connection with theaccompanying figures. It is to be expressly understood, however, thateach of the figures is provided for the purpose of illustration anddescription only and is not intended as a definition of the limits ofthe present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the disclosed methods andapparatuses, reference should be made to the embodiments illustrated ingreater detail in the accompanying drawings, wherein:

FIG. 1 is a block diagram of a system providing automated monitoring andcontrol of manufacturing processes in accordance with embodiments of thepresent disclosure;

FIG. 2 is a block diagram of an AGV configured to facilitate itemretrieval in accordance with embodiments of the present disclosure;

FIG. 3 is a block diagram of an electronic device providingfunctionality for retrieving items in accordance with embodiments of thepresent disclosure;

FIG. 4 is a block diagram illustrating aspects of AGV operations forretrieving items in accordance with embodiments of the presentdisclosure;

FIG. 5 is a block diagram illustrating navigation of an AGV during itemretrieval in accordance with embodiments of the present disclosure;

FIG. 6 shows block diagrams illustrating aspects of coordinate systemfunctionality in accordance with embodiments of the present disclosure;

FIG. 7 is a block diagram illustrating different AGV bin configurationsin accordance with embodiments of the present disclosure;

FIG. 8 is a block diagram illustrating aspects of configuring one ormore bins of an AGV in accordance with embodiments of the presentdisclosure;

FIG. 9 is a block diagram illustrating aspects of utilizing a 3dimensional coordinate system in accordance with embodiments of thepresent disclosure;

FIG. 10 is a block diagram illustrating aspects of identifying an itemof interest in accordance with embodiments of the present disclosure;

FIG. 11 is a flow diagram of an exemplary process for retrieving itemsfrom a facility using AGVs in accordance with embodiments of the presentdisclosure;

FIG. 12A is a block diagram illustrating aspects of providinginformation associated with items to be retrieved using a graphical userinterface in accordance with the present disclosure;

FIG. 12B is a block diagram illustrating aspects of providinginformation associated with items to be retrieved using a graphical userinterface in accordance with the present disclosure;

FIG. 12C is a block diagram illustrating aspects of providinginformation associated with items to be retrieved using a graphical userinterface in accordance with the present disclosure;

FIG. 12D is a block diagram illustrating aspects of providinginformation associated with items to be retrieved using a graphical userinterface in accordance with the present disclosure;

FIG. 12E is a block diagram illustrating aspects of providinginformation associated with items to be retrieved using a graphical userinterface in accordance with the present disclosure; and

FIG. 13 is a flow diagram of an exemplary method for retrieving itemsfrom an item and storage infrastructure in accordance with embodimentsof the present disclosure.

It should be understood that the drawings are not necessarily to scaleand that the disclosed embodiments are sometimes illustrateddiagrammatically and in partial views. In certain instances, detailswhich are not necessary for an understanding of the disclosed methodsand apparatuses or which render other details difficult to perceive mayhave been omitted. It should be understood, of course,. that thisdisclosure is not limited to the particular embodiments illustratedherein.

DETAILED DESCRIPTION

The systems and methods disclosed herein provide a digitalized supplychain integrated with ERP and other systems to achieve frictionlessproduction capabilities that may be customized to various differentindustries. The solutions provided by the present disclosure Facilitatelocation, retrieval, and transport of items or materials from a dispatcharea (e.g., a storage infrastructure facility or warehouse) to adestination location. The items or materials may be retrieved,transported, and delivered to the destination location for use in aproduction process, such as a manufacturing or assembly processconfigured to produce a product or a sub-component of a product usingthe delivered items or materials. The delivery of the items or materialsmay be timed such that the materials arrive to the destination locationat or near the time at which the production process is ready to use theitems or materials, thereby ensuring the production processes supportedby the systems and methods of the disclosed embodiments may continueuninterrupted, which improves the overall efficiency of themanufacturing process and ensures production capacity of themanufacturing processes maintained or near a maximum level

Retrieval, transport, and delivery of the items or materials may befacilitated, at least in part, by AGVs. As described in more detailbelow, the AGVs may include bin into which items or materials scheduledfor retrieval and delivery may be placed and once a specified set ofitems or materials have been loaded into the bins the AGVs may navigateto the destination area to deliver the items or materials. The AGVs mayutilize virtualized coordinate systems to navigate to items or materialsof interest (e.g., items or materials scheduled for retrieval anddelivery) and then to the destination location where the items ormaterials of interest are to be delivered items or materials stored inthe storage infrastructure may be assigned coordinates within thevirtual coordinate system and the AGV may travel to the items ofinterest via a route determined within the coordinate system using thecoordinates of the items of interest. When the item or materialretrieval process is performed in a human-assisted manner, the automaticnavigation of the AGV to the items of interest may allow the items ormaterials to be retrieved more efficiently (e.g, the human assisting inthe retrieval process will typically not be able to locate the items asquickly or plan optimum routes fir retrieving the items as compared tothe routes determined by the AGV). Where the item or retrieval processis performed without human assistance, the retrieval process may beperformed automatically and continuously (subject to battery or otherpower requirements of the AGV), thereby enabling the manufacturingprocesses to be carried out continuously and allowing the manufacturerto allocate more resources to the manufacturing process and lessresources to item retrieval and delivery tasks. Additional advantageousaspects of the systems and methods disclosed herein will become apparentfrom the description that follows.

Referring to FIG. 1, a block diagram of a system providing automatedmonitoring and control of manufacturing processes in accordance withembodiments of the present disclosure is shown as a system 100. As shownin FIG. 1, the system 100 may include one or more customer devices 110,one or more servers 120, one or more databases 130, one or more userdevices 150, one or more automated guided vehicles (AGVs) 160, item andstorage infrastructure 170, and production/assembly area 180. Exemplaryaspects of the one or more AGVs 160 are described in more detail belowwith reference to FIGS. 2 and 4-11. Aspects of the user devices 150 aredescribed in more detail below with reference to FIGS. 3 and 11-12E.Each of the one or more servers 120 may include one or more processors,memory devices, communication interfaces, and other devices configuredto facilitate the functionality described with reference to theexemplary servers disclosed herein, such as an ERP server, a warehouseor facility management server, an inventory management system, and thelike. It is noted that functionalities described with reference to eachof the different servers and system described herein is provided forpurposes of illustration, rather than by way of limitation and thatfunctionalities described as being provided by different servers may becombined into a single server or may be provided via computing resourcesdisposed in a cloud-based environment accessible over a network, such asone of the one or more networks 140. Further, it is noted that althoughillustrated separately from the one or more servers 120, the one or moredatabases 130 may be stored at memory of a particular server orcombination of servers in some embodiments.

The one or more networks 140 may communicatively couple different onesof the one or more customer devices 110, the one or more servers 120,the one or more databases 130, the one or more user devices 150, the oneor more automated guided vehicles (AGVs) 160, the item and storageinfrastructure 170, and the production/assembly areas 180 to each other.For example, the one or more networks 140 may communicatively couple thecustomer devices 110 to an ERP server (e.g., one of the one or moreservers 120) that provides a customer-facing interface that enablescustomers of the system 100 to configure and place orders with the ERPserver. Once an order is configured and received by the ERP server, theorder may be processed by the ERP server and information may bedistributed via the one or more networks 140 to one or more otherservers, such as a warehouse facility server associated with the itemand storage infrastructure 170 and the production/assembly area 180. Thewarehouse facility server may analyze the information received from theERP server and generate messages that are then transmitted to one ofuser devices 150 and one of the AGVs 160. The information provided tothe user device 150 and the AGV 160 may be configured to facilitateoperations to retrieve items from the item and storage infrastructure170 and deliver the items to the production/assembly area 180. The itemsdelivered to the production/assembly area 180 may be utilized tocomplete a manufacturing or assembly process corresponding to the orderreceived by the ERP server from the customer device 110. Exemplaryaspects of the aforementioned processes are described in more detailbelow with reference to FIGS. 2-11.

As the items are retrieved, the user device 150 and the AGV 160 maycommunicate with the warehouse facility server or another serverconfigured to manage inventory stored in the item storage infrastructure170, such as to provide information regarding items retrieved from theitem storage infrastructure 170 for consumption by the manufacturing,process performed upon delivery of the retrieved items to theproduction/assembly area 180, As the items are retrieved and deliveredto the production/assembly area 180, the warehouse facility server orother server configured to manage inventory information may receive theinformation from the user device 150 and/or the AGV 160 and update adatabase (e.g., one of the databases 130 associated with inventoryinformation corresponding to the item and storage infrastructure fromwhich the item(s) is retrieved) to reflect that the retrieved items havebeen consumed by the manufacturing process, such as to reduce theavailable quantity of the retrieved item(s) in the inventory database.As described in more detail below, the user device 150 and the AGV 160may include functionality and hardware configured to verify itemretrieval operations and validate the item retrieval operations werecompleted correctly prior to changes in the inventory database beingmade. In an aspect, the ERP server or the warehouse facility managementserver may be configured to automatically order additional quantities ofitems based on current inventory levels, such as to order additionalquantities of an item when current quantities on hand fall below athreshold level or when production forecasts (e.g., forecasts of futureorders) suggest a spike in demand for particular items. These automatedrestocking processes may be configured to schedule delivery of theadditional quantities of items prior to current supplies of the itemsbecoming exhausted, which would halt production operations at themanufacturing/assembly area 180.

As will become apparent from the description that follows, thefunctionality provided by the system 100 provides several improvementsto systems and processes utilized in manufacturing of products and/orsub-components of products. For example, the item retrieval validationfunctionality briefly described above ensures that inventory levelsreflected in the inventory database(s) accurately reflect on-handquantities of the items utilized in the manufacturing processesperformed in the production/assembly area. Additionally, the AGVs ofembodiments include functionality that enables rapid identification ofparticular items to be retrieved, such as automated navigation to theitems required to process a received order, providing visual indicationsof the items to be retrieved and locations on the AGV where theretrieved items should be placed to ensure that the validation processesconfigured to verify item retrieval accuracy operate properly, andautomated delivery of the retrieved items to the production/assemblyarea 180. Another advantage realized by the system 100 is theminimization of human labor to transport items. For example, the AGVsinclude bins into which retrieved items may be placed. As the items forone or more orders are retrieved, the items may be carried in the binsof the AGV (rather than by humans) and the AGV may automatically deliverthe collected items to the production/assembly area once all items arecollected and verified as correct. This eliminates the need to havehumans transport the items by hand or by cart, reducing the costsassociated with retrieving items from the item and storageinfrastructure 170 and delivering the items to the production/assemblyarea 180.

Machine learning algorithms may also he employed by the servers 120 toselect the particular item and storage infrastructure, AGV, andproduction/assembly area from which an order is to be fulfilled. Asdescribed in more detail below, the machine learning algorithms may beprovided by a rules engine executing on one of the servers 120 (e.g., awarehouse facility management server). The machine learning algorithmsmay account for current capacity of the production/assembly areas 180,current quantities of items available at the different item storageinfrastructures 170, and AGV availability and configurations to select acombination of these system features that can efficiently process arequested order. Additionally, rather than initiating item retrievalbased on reception of a particular order, the ERP server may beconfigured to provide information regarding a forecasted demand forproducing a particular product and items utilized to produce theparticular product. Based on the forecasted demand, periodic retrievalof items may be scheduled to ensure that appropriate quantities of itemsare provided to the manufacturing/assembly areas to facilitateproduction of the products at levels that at least meet the forecasteddemand. Such periodically scheduled item retrievals may be rapidlychanged to account for changes in forecasted demand, such as to modifythe scheduled item retrievals from a first set of items associated withmanufacturing a first product to periodic retrievals of a second set ofitems associated with manufacturing a second product, which may occurbased on changes to the real-time or forecasted demand for products.Additional advantages and improvements realized by the systems andtechniques disclosed herein will be apparent from the descriptionprovided below with respect to FIGS. 2-14.

Referring to FIG. 2, a block diagram of an AGV configured to facilitateitem retrieval in accordance with embodiments of the present disclosureis shown as an AGV 200. In an aspect, the AGV 200 may be part of asystem (e.g., the AGV 160 of FIG. 1 and provide functionality forlocating and transporting parts, materials, and the like in a productionfacility environment. As shown in FIG. 2, the AGV 200 may include one ormore processors 210, a memory 220, configurable bin(s) infrastructure230, one or more sensors 240, a motion and propulsion control system250, and one or more input output devices 260. The one or moreprocessors 210 may include one or more microcontrollers, applicationspecific integrated circuits (ASIC), field programmable gate arrays(FPGAs), central processing units (CPUs) having one or more processingcores, or other circuitry and logic configured to facilitate theoperations of the AGV 200 (and other AGV s described herein) inaccordance with aspects of the present disclosure. The memory 220 mayinclude RAM, ROM, EEPROM, HDDs, SSDs, flash memory devices, or othermemory devices configured to Store instruction in a persistent ornon-persistent state. Software configured to facilitate operations andfunctionality of the AGV 200 may be stored in the memory as instructions222 that, when executed by the one or more processors 210, cause the oneor more processors to perform the operations described herein withrespect to the AGV 200, as described above with reference to the AGVs160 of FIG. 1 and as described in more detail below. Although notillustrated in FIG. 2 for simplicity of the drawing, AGVs of embodimentsmay include a power source, such as one or more batteries, configured toprovide operational power to the components of the AGV described herein.

As briefly described above, the AGV 200 may include one or more bins 230that are provided to receive items (e.g., parts and/or products)retrieved from a storage area and contain the items during transport toanother area, such as a production or assembly facility where the itemsmay be used as part of another process, such as a process to assemble afinal product. The number of bins, as well as the size of the bins, thata particular AGV 200 includes may be configurable depending on the typesof items for which the AGV 200 will be utilized. For example andreferring briefly to FIG. 8, a block diagram illustrating aspects ofconfiguring one or more bins of an AGV in accordance with embodiments ofthe present disclosure is shown. As shown in FIG. 8, AGVs of embodimentsmay include a bin interface 810 that may include a plurality ofapertures 812. The apertures 812 may be configured to receive retainingmembers disposed on a surface (e.g., a bottom surface) of the bins. Forexample, as shown in FIG. 8, a first bin 820 may include retainingmembers 822, 824. The bin 820 may be removably coupled to the bininterface 810 by seating the retaining members 822, 824 withinparticular ones of the apertures 812 of the bin interface 810. Asadditionally shown in FIG. 8, a second bin 830, which may be smaller inat least one dimension (e.g., a length, width, and/or height) mayinclude retaining member 832, 834 that may be removably coupled to thebin interface 810 by seating the retaining members 832, 834 withinparticular ones of the apertures 812 of the bin interface 810.

In an aspect, the retaining members 822, 824, 832, 834 may compriseposts that are sized and dimensioned to sit within the apertures 812 ofthe bin interface, such that once the retaining members 822, 824, 832,834 are seated within the apertures 812, the bins 820, 830 are securely(e.g., the bins 820, 830 do not slide around as the AGV moves) held inplace by the bin interface 810. In an additional or alternative aspect,the apertures 812 may be threaded and the retaining members may beembodied as screws or some other type of mechanism that is configured tothreadably engage the apertures 812. Using a threaded engagement mayensure that the bins are secured to the bin interface and will notbecome dislodged (e.g., if the AGV is bumped er experiences some otherfor in of impact or turbulence). It is noted that the bins utilized byembodiments may include square bins, rectangular bins, circular bins, orsome other shape of bin depending on the particular application(s) towhich the bins may be utilized. Further, it is noted that AGVs ofembodiments may include a bin interface disposed on the top surface ofthe AGV and/or one or more sides of the AGV, For example, a bininterface on the top of the AGV may be configured with one or more binshaving a box-like shape, such as to house and store one or more itemsfor transport. Additionally, it is noted that bins are not limited tobox-like shapes. To illustrate, a bin interface on a side of the AGV mayinclude one or more bins 840 having arms 842 and hooks or retaining bars844 designed to hold elongated items (e.,g, poles, rods, or other longeritems). Further, it is to be understood that bins utilized in connectionwith AGVs in accordance with the present disclosure may have other formfactors, sizes, and shapes depending, on the particular items to beloaded on or within the bins. It is noted that when bins are utilizedwith a bin interface disposed on a side of the AGV, utilizing threadedretaining members 846 may ensure that the bins do not become dislodgedor separated from the bin interface of the AGV is noted that theconcepts described above with respect to the bin interface 810 and theretaining members of the bins have been provided for purposes ofillustration, rather than by way of limitation and that other types ofmechanisms may be utilized to secure bins to the bin interfaces of AGVsin accordance with aspects of the present disclosure. Further, it isnoted that the ability to removably couple the bins to the AGVs mayenable different AGVs to be configured with different types of bins,which may allow AGVs to be configured to transport more or less itemsdepending on the particular tasks to be completed.

Referring back to FIG. 2, the one or more sensors 240 of the AGV 200 mayinclude weight sensors, pressure sensors, accelerometers, gyroscopes,proximity sensors, or other sensors configured to provide information tothe AGV 200 regarding its operation and operating environment. Theweight sensor(s) or pressure sensor(s) may be utilized to determinewhether one or more items have been placed into the bins of the AGV 200,as described in more detail below. The accelerometers, gyroscopes, andproximity sensors may provide sensor data to the motion and propulsioncontrol system 250, which may use at least a portion of the sensor datato control navigation and movement of the AGV 200, as described in moredetail below. For example, during, navigation of the AGV 200 sensor dataprovided by the proximity sensors may be utilized to detect obstacles inthe path of travel of the AGV 200. When an obstacle is encountered anddetected by the AGV 200, the navigation module may reroute the AGV 200around the obstacle or the input/output (I/O) devices 260 may generatean alert, such as a beep or other sound, or flash one or more lights toindicate an obstacle has been encountered and needs to be removed fromthe path of the AGV 200.

The I/O devices 260 of the AGV 200 may include communication interfaces(e.g., network communication interfaces, universal serial bus (USB)interfaces, Bluetooth communication interfaces, and the like) configuredto communicatively couple the AGV 200 to local devices (e.g., via theUSB interface, etc.) and remote devices (e.g., via the networkcommunication interfaces, Bluetooth communication interfaces, etc.).Such communication capabilities may enable bidirectional communicationbetween the AGV and one or more local and external devices duringoperation of the AGV 200. For example, as briefly described above,during operation of the AGV 200 items may be placed into the bin(s) ofthe AGV 200. As items are detected as being placed within the bin(s)(e.g., based on the sensor data, provided by the weight and/or pressuresensors) the AGV 200 may communicate with a user device (e.g., one ofthe user devices 150 of FIG. 1) to confirm the part has been placed inthe (correct) bin. Such communication may be facilitated by a wirelesscommunication link (e.g, a Bluetooth communication link, a WirelessFidelity (Wi-Fi) communication link., and the like) established betweenthe AGV 200 and the user device. The communication links utilized by theAGV 200 may also be configured to communicatively couple the AGV 200 toone or more remote servers, such as one or more of the servers 120described above with reference to FIG. 1, and the one or more databases130 of FIG. 1. For example, as items are placed into the bin(s), the AGV200 may be configured to communicate information to one of the databases130 of FIG. 1. (e.g., an item or inventory database) to indicate thatone or more items of inventory have been consumed (e.g., taken frominventory for use in a manufacturing or assembly process).Alternatively, the AGV 200 may communicate information to a server andthe server may update the database(s) 130. The AGV 200 may also transmitinformation. to one of the servers 120 (e.g., a production or warehouseserver) to indicate that items for a particular order have beenretrieved and will soon be delivered to a manufacturing/assembly area.Additionally or alternatively the user devices (o,g, the user devices150 of FIG. 1) may provide the information to the database to indicatethat one or more items of inventory have been consumed. Transmission ofsuch information by the user device(s) may, in some aspects, beinitiated upon receiving confirmation that the item has been placed intothe bin, from the AGV (e.g, a confirmation transmitted by the AGV 200based on the sensor data received from the weight and/or pressuresensor(s)). It is noted that the weight of the items may he used totrack. a number of items that have been placed into the bins. Forexample, suppose an item weights 1 pound and a total of 4 units of theitem are to be retrieval. The weight information may be monitored by theAGV 200 to determine when 4 items have been placed into the bin, such aswhen the weight information indicates that 4 pounds have been detectedas being placed in the bin. If the AGV 200 detects a discrepancy, such,as the weight of the items placed in the bin reading 2.6 pounds, the AGV200 may determine that an incorrect item has been placed in the bin andmay generate an alert. Thus, the AGV 200 may be configured to trackinformation associated with whether the correct items are placed intothe correct bins based on weight information. Validating the accuracy ofthe items placed in each bin may ensure that the correct items aredelivered to the production/assembly area in the correct quantities sothat production processes do not become delayed due to insufficient orincorrect delivery of items. Further, the ability to track the accuracyof items placed into the bins in real-time using weight informationensures that any errors are caught quickly and corrected.

The I/O devices 260 may also include one or more optical devices, suchas light emitting diodes (LEDs) or other light sources, lasers, cameras,and the like. The light sources or LEDs may be disposed proximate to theone or more bins or even disposed on the bins. Where the light source(s)is disposed on a bin, one of the retaining members of the bin may beconfigured to provide an electrical connection in addition to securingthe bin to the bin interface. For example, when the retaining membermaking the electrical connection is interfaced with the bin interface,the aperture receiving the retaining member may dispose proximatecircuitry or electrical connection logic that is configured toselectively provide power to the light source of the bin. The lightsource(s) associated with a particular bin may be configured to light upto identify into which bin an item should be placed, as described inmore detail below. In an aspect, lasers may be provided to highlight oridentify particular items within a warehouse or other area where theitems are stored prior to retrieving the items utilizing the AGV 200.When provided, the laser(s) may be pivotably mounted on the AGV 200. Theone or more processors 210 of the AGV 200 may be configured control thedirection or orientation, of the laser(s) so that the correct item(e.g., the next item to be received in one of the bins 230) isidentified for retrieval, such as to point the laser at a location of anext item to be retrieved, as described in more detail with reference toFIG. 9. For example, as described below, the AGV 200 may receiveinformation that identifies one or more items that are to be retrieved.This information may be analyzed and locations associated with each itemwithin a warehouse may be identified. Once the known locations of theitems are determined, the motion and propulsion control system 250 maybe configured to control movement of the AGV 200 to the appropriatelocations where the items may be retrieved and placed within the correctones of the bins 230.

As further illustrated in FIG. 2, the motion and propulsion controlsystem 250 may include one or more controllers 252, one or more motors254, traction components 256, and a navigation module 258. The one ormore controllers 252 may be configured to control operations of the oneor more motors 254 and the traction components 256 to navigate the AGV200 from a first location to a second location (e,g, a starting locationto a first item location, from a previous item location to a next itemlocation, or from a last item location to an item drop off point). Thetraction components 256 may include wheels, belts or treads, or othercomponents configured to allow the AGV 200 to traverse a distance basedon driving forces provided by the one or more motors 254. In an aspect,the one or more motors 254 driving the traction components 256 mayinclude one or more stepper motors configured to drive the tractioncomponents 256 in discrete increments. Utilizing stepper motorsconfigured to drive the traction components 256 in discrete incrementsmay provide advantages over other types of motor drive systems. Forexample, as explained herein, the AGV 200 may be configured toautonomously navigate from a starting location to one or more remotelocations to retrieve items (e.g. from a warehouse or storage facility)and then to a destination location, such as a location where the itemsmay be unloaded. form. the AGV 200 for further processing. To facilitatesuch navigation, the warehouse and other destinations through which theAGV 200 may navigate may be mapped to a coordinate system, which mayinclude a 2 dimensional coordinate system or a 3 dimensional coordinatesystem, as described in more detail below with reference to FIGS. 4-6and FIG. 9. As the stepper motors are driven, each step of the steppermotors may move the AGV 200 one discrete unit of distance.

The discrete unit of distance may be applied to the coordinate system todetermine a distance traveled by the AGV 200 within the coordinatesystem. In an aspect, the coordinate system may be directly scaled tothe discrete units of distance traveled by each step and each discreteunit of distance traveled in a first direction (e.g., an “X” direction)may represent 1 unit of distance traveled in the first direction. Toillustrate, starting from a first location (e.g., 0, 0) and driving thestepper motor 3 discrete steps may cause the AGV 200 to travel 3 unitsof distance in the first direction (e.g. after the 3 discrete steps theAGV 200 is located at (3, 0)) and 8 more discrete steps in the firstdirection by the stepper motor cause the AGV 200 to travel 8 units ofdistance in the first direction (e.g., after the 8 more discrete stepsthe AGV 200 is located at (11, 0)). In an additional or alternativeaspect, the coordinate system may be scaled to a number of discreteunits of distance traveled by each step such that a particular number ofdiscrete units of distance traveled in a first direction (e.g, an “X”direction) represents 1 unit of distance traveled in the first directionwithin the coordinate system. To illustrate, starting from a firstlocation (e.g., 0, 0) and assuming 10 discrete steps represents 1 unitof distance traveled in the coordinate system, if the stepper motor isdriven 3 discrete steps the AGV 200 may travel 0.3 units of distance inthe first direction (e.g., after the 3 discrete steps the AGV 200 islocated at (0.3, 0)) and traveling 8 more discrete steps in the firstdirection causes the AGV 200 to travel 0.8 additional units of distancein the first direction (e.g., after the 8 more discrete steps the AGV islocated at (1.1, 0)). In an aspect, the discrete steps may correspond toa rotation of 0.8° (e.g., if the traction component is a wheel, eachstep of the stepper motor rotates the wheel) 0.8°. The size of the wheel(e.g., circumference, radius, diameter, etc.) and the degree of rotation(e.g., 0.8° in this example) may be utilized to calculate the distancetraveled by each discrete step (e.g., each 8 rotation of the wheel) andmay be used to track the distance traveled by the AGV in the coordinatesystem, as described above.

While the description above illustrates tracking linear movement (e.g.,in a single direction) of the AGV 200 within the coordinate system, thenavigation module 258 may also be configured to track movement andnavigation of the AGV 200 in two dimensions (e.g., an X direction and aZ direction) and along combinations of directions in two dimensionssimultaneously. The AGV 200 may be configured to steer using a centerwheel drive and pivoting mechanism that provides the AGV 200 with 360°of turning radius. In an aspect, the AGV 200 may be steered or turnedusing differential speed control. To illustrate, two motors may beprovided and driven at varying speeds and the speed of each motor andtheir direction of rotation may determine whether the AGV 200 movesforward (e.g., both motors being driven at the same speed and in a firstdirection), backward (e.g., both motors being driven at the same speedand in a second direction—a direction opposite the first direction), orturn left or right (e.g., both motors being driven at the differentspeeds in particular directions). It is noted that steering viadifferential speed control may also provide a smaller diameter turnradius, which may minimize drift daring turning. It is to be understoodthat the exemplary techniques f,or tracking the distance traveled by theAGV 200 within a coordinate system described above have been providedfor purposes of illustration rather than by way of limitation and thatsystems and AGVs according to the present disclosure may utilize othertechniques for tracking movement and navigation of an AGVs in accordancewith the concepts disclosed herein. For example, additional techniquesfor controlling navigation of AGVs and tracking of the location of AGVsare described and illustrated below with reference to FIG. 6.

To facilitate consistent autonomous navigation of the AGV 200, thenavigation module 258 may be configured to store information associatedwith the coordinate system, such as information that maps particularlocations within the coordinate system to points of interest (e.g., adocking station where the AGV 200 may return when not in use torecharge, be reconfigured with different bins, coordinates of itemdestinations, etc.), Additionally, the navigation module 258 may beconfigured to store information associated with items stored in thestorage facility and location information associated with destinationswhere the AGV 200 may unload items. The navigation module 258 may alsohe configured to dynamically determine locations within the coordinatesystem via communication with one or more remote devices, such as one ormore remote servers (e.g., one or more of the servers 120 of FIG. 1) orremote sensors, Additional operations and aspects of AGVs according tothe present disclosure are described in more detail below with referenceto FIGS. 4-6 and FIG. 9, After a. delivery of items to the appropriatemanufacturing/assembly area occurs, the AGV 200 may return to itsdocking bay (e.g., to recharge its batteries) if there are no morescheduled items to retrieve,

In an aspect, each time the AGV returns to the docking bay it mayrecalibrate the navigation system with respect to the current locationof the AGV, For example, as described above, each docking bay may have adefined coordinate location within the coordinate system used fornavigation by the AGV. Although the discrete units of distance mayminimize drift with respect to navigation of the AGV within thecoordinate system, inconsistencies may build up over time resulting inslight discrepancies between the location calculated based on the numberof steps and direction of travel of the AGV and the actual locationwithin the coordinate system that the AGV currently occupies.Recalibrating the location of the AGV as it periodically returns to thedocking bay may minimize the impact that such drift has on thenavigation system and refresh the navigation system accuracydynamically. For example, the one or more batteries of the AGV may havea theoretical runtime of approximately 10 hours, hut actual runtimes maybe in the range of 5 to 7 hours during operation due to lossesassociated with heat, load, friction, and the like. It is noted that theexemplary operations described above to minimize drift of the navigationsystem by periodically recalibrating the location of the AGV to a knownlocation within the coordinate system (e.g., the coordinates of theAGV's docking bay) has been provided for purposes of illustration,rather than by way of limitation and that other techniques formitigating the effects of drift may also be utilized by the AGVs ofembodiments.

In some embodiments, rather than relying on a user to retrieve the itemand place the item in the appropriate bin of the AGV 200, the AGV 200may be configured with item retrieval components 270. The item retrievalcomponents 270 may include robotic arms, movement control components(e.g., servos, gears, etc.), hydraulics (e.g., to drive the movementcontrol components and control movement of the robotic am), and controllogic configured to determine one or more movements of the robotic armto place it in proximity to an item to be retrieved and to controlactivation of the movement control components and the hydraulics toexecute the determined one or more movements. Additionally, once an itemhas been retrieved, the control logic may determine one or moremovements of the robotic arm and associated control components to causethe robotic arm to place the retrieved item into the appropriate bin ofthe AGV 200. In embodiments where item retrieval components 270 areprovided, AGVs may be enabled to operate in a near-continuous mannerwithout human intervention, enabling more resources to be dedicated tothe manufacturing of products (e.g., due to requiring less resources toretrieve the items used in the manufacturing process). It is noted thatthe item retrieval components described above have been provided forpurposes of illustration, rather than by way of limitation, and thatother types of components and drive mechanisms may be utilized tofacilitate automatic retrieval of items by AGVs in accordance with theconcepts disclosed herein.

Referring to FIG. 3, a block diagram of an electronic device providingfunctionality for retrieving items in accordance with embodiments of thepresent disclosure is shown as an electronic device 300, In an aspect,the electronic device 300 may be a tablet computing device, a laptopcomputing device, a smartphone, a personal digital assistant (PDA), oranother type of electronic device configured to perform the operationsof the user device 300 (and the user device(s) 150 of FIG. 1) describedherein. As shown in FIG. 3, the electronic device 300 includes one ormore processors 310, a memory 320, and I/O devices 330. The one or moreprocessors 310 may include one or more microcontrollers, applicationspecific integrated circuits (ASIC), field programmable gate arrays(FPGAs), central processing units (CPUs) having one or more processingcores, or other circuitry and logic configured to facilitate theoperations of the user device 300 (and other user devices describedherein) in accordance with aspects of the present disclosure. The memory320 may include RAM, ROM, EEPROM, HDDs, SSDs, flash memory devices, orother memory devices configured to store instruction in a persistent ornon-persistent State, Software configured to facilitate operations andfunctionality of the electronic device 300 may be stored in the memory320 as instructions 322 that, when executed by the one or moreprocessors 310, cause the one or more processors to perform theoperations described herein with respect to the user device 300 and theuser devices 150 of FIG. 1. Additionally, functionality provided by userdevices of embodiments is described in more detail below with referenceto FIGS. 11 and 12.

The I/O devices 330 of the electronic device 300 may include a displayscreen or device configured to display information to a user. The 110devices 330 may also include one or more input devices for receivinginformation from a user, using for example, haptic-based input,voice-based input, movement-based input, vision-tracking input, and thelike Exemplary I/O devices for providing such input capabilities mayinclude a touchpad, a keyboard, a mouse, a stylus, a. touch screeninterface facilitating user inputs via a user touching the displayscreen at particular locations (e.g., locations where one or more iconsconfigured to solicit particular inputs from the user are located), orother devices. The I/O devices 330 of the electronic device 300 may alsoinclude communication interfaces (e.g., network communicationinterfaces, universal serial bus (USB) interfaces, Bluetoothcommunication interfaces, and the like) configured to communicativelycouple the electronic device 300 to local devices (e.g., via the USBinterface, etc.) and remote devices (e.g., via the network communicationinterfaces, Bluetooth communication interfaces.

The communication capabilities provided by the communicationinterface(s) may enable bidirectional communication between theelectronic device 300 and one or more local and external devices duringoperations to retrieve items. For example, as briefly described above,during retrieval of items information may be presented at the electronicdevice 300 to identify a particular item that is to be retrieved andplaced into the bin(s) of an AGV (e.g., the AGV 200 of FIG. 2). Toillustrate and referring to FIGS. 12A-12E, various block diagramsillustrating aspects of providing information associated with items tobe retrieved in accordance with the present disclosure are shown, In theexamples illustrated in FIGS. 12A-12E, the electronic device 300 of FIG.3 is shown displaying information on a display screen 1202. For example,in FIG. 12A, the display screen 1202 is shown displaying informationassociated with four items to be retrieved, where the items are noted asitems 1210, 1220, 1230, 1240. Initially, the display screen may displayeach of the items 1210, 1220, 1230, 1240 in a first color, denoted bythe shading illustrated in FIG. 12B. The first color may indicate whichitems have yet to be retrieved. Upon retrieving the item 1210, thedisplay region associated with the item 1210 may be updated from thefirst color to the second color, as shown in FIG. 120. Subsequent toretrieving the first item 1210, the item 1220 may be retrieved and thedisplay region corresponding to item 1220 may he updated to the secondcolor, as shown in FIG. 12D. As the item 1230 is retrieved the displayregion corresponding to item 1230 may be updated to the second color, asshown in FIG. 12E. This process may continue until all items areretrieved, In an aspect, more than two colors may be utilized toindicate a status of the item retrieval process. For example, the firstcolor (e,g, red) may be used to indicate a task for retrieving one ormore associated items is incomplete, the second color (e.g., green) maybe used to indicate the task for retrieving one or more associated itemsis complete, and a third color may he used to indicate the task ispartially complete, such as to indicate that at least some of the itemshave been retrieved correctly but that the retrieval task is incomplete(e.g., the quantity of items retrieved is less than a total quantity ofitems to be retrieved, etc.). It is noted that the exemplary colorschemes described above have been provided for purposes of illustration,rather than by way of limitation and that other color schemes may beutilized to provide feedback to the user during retrieval of itemsdepending on the particular configuration of the system and interface.

In an aspect, one or more icons or other firms of interactive elementsmay be presented in the different display regions associated with eachof the items 1210, 1220, 1230, 1240 during retrieval of items. Forexample, an icon requesting the user of the electronic device 300 toconfirm the item being currently retrieved has been placed in the bin ofthe AGV may be provided. The user may interact with (e.g., select orclick) the icon to confirm that the item has been placed in the bin.Upon receiving the input indicating the item has been placed in the bin,information may be transmitted from the electronic device 300 to aremote device, such as one of the servers 130 of FIG. 1. The server(e.g., a warehouse server or sonic other server configured to trackprogress of item retrieval processes and inventor may use theinformation transmitted from the electronic device 300 to update aninventory database to indicate quantities on hand (e,g, after removal ofthe one or more items retrieved by the user). In an aspect, theinventory database may he updated after receiving the information fromthe electronic device 300 and confirmation of the item(s) being receivedin the bin(s) from the AGV. Utilizing information received from both theelectronic device 300 and the AGV may improve the accuracy of theinventory database by preventing updates of the database if the userretrieves the incorrect item or places the item in the incorrect bin. Asdescribed elsewhere herein, the AGV may be configured with functionalityto verify that a retrieved item has been placed in the correct bin, andthe information transmitted by the AGV may only be transmitted if theitem is placed in the correct bin or may indicate that the incorrectitem has been retrieved, which may prevent the inventor database frombeing updated until the defect is corrected (e.g, the item is placed inthe correct bin or the correct item is placed in the bin).

In addition to providing interactive elements or icons configured toreceiving inputs confirming an indicated item has been placed into abin(s) of the AGV, the display regions corresponding to each item mayalso be configured to display an image of the item, which may enable theuser to visually confirm the retrieved item is correct by comparing theitem to the image displayed on the display screen 1202. It is noted thatother information may also be displayed, such as a quantity of the itemto be retrieved, a name of the item, a part number of the item, and thelike. Additionally, the display screen 1202 may present informationassociated with a particular bin into which the retrieved item is to beplaced. For example, a graphic or icon may he presented that illustratesthe bin configuration of the associated AGV and the bin into which theitem is to be placed may be highlighted or otherwise identified to theuser. The graphical user interface(s) provided by the electronic device300 may also include information that indicates a number of items to beretrieved (e.g. retrieve 2 of a first item, 1 of a second item, 5 of athird item, and the like).

Additionally or alternatively, the storage bins from which the items areretrieved may have a display (e.g., a liquid crystal display, a sevensegment display, etc.) configured to display the number of items to beretrieved. Such display devices may be communicatively coupled to one ormore servers (e.g., the one or more server 120 of FIG. 1) and/or the AGV200 and the quantity displayed at the display of the storage bin may becontrolled based on information provided by the server(s) or the AGV200. For example, the AGV 200 may provide information to a server thatindicates the AGV 200 is at a particular waypoint corresponding to anitem to he retrieved and the server may transmit information to thestorage bin corresponding to the item to control activation of the LEDassociated with the storage bin and to cause the display associated withthe storage bin to display the quantity of items to be retrieved fromthe storage bin and loaded onto the AGV. Alternatively, the AGV 200 maytransmit the information for activating the LED and siaplying thequantity on the display directly to the storage bin.

In an aspect, the storage bins may be configured with a pressure orweight sensor configured to detect each time an item is removed from thestorage bin and the display of the quantity may be updated (e.g., deermerited) each time an item is removed. In an aspect, one or more of theservers (e.g., the one or more servers 120 of FIG. 1) may be configuredto monitor the quantities of items held in each of the storage binsbased on the weight information provided by the pressure or weightsensor and may automatically order additional quantities of items whenthe weight information indicates on-hand quantities have fallen below athreshold level. The determination to order additional quantities ofitems may also be based, at least in part, on forecasted demand for theitems. For example threshold triggering automatic orders of items (e.g.,to replenish available inventory) may be periodically updated based onforecasted future demand for products manufactured from the items. Asforecasted demand increases the threshold(s) may he raised to ensurethat sufficient quantities remain on hand and avoid situations whereshortages occur (e.g., production processes would not be delayed if adelivery of items is late) and as forecasted demand decreases thethreshold(s) may be decreased to avoid carrying excess inventory. It isnoted that the exemplary functionality and components described abovewith reference to the electronic device 300 and the displays associatedwith the storage bins have been provided for purposes of illustration,rather than by way of limitation and that additional functionality andfeatures may be provided by electronic devices configured according toaspects of the present disclosure.

Referring to FIG. 4, a block diagram illustrating aspects of AGVoperations for retrieving items in accordance with embodiments of thepresent disclosure is shown, In an aspect, the environment illustratedin FIG. 4 may correspond to a warehouse or other type of facility whereitems are stored for later use in other processes, such as manufacturingand assembly processes where retrieved items are combined for finalcomponents, products, sub-components, and the like, As shown in FIG. 4,a plurality of items 402-432 may be arranged in rows and/or columnswithin a facility. To facilitate identification of specific items of theplurality of items 402-432, each item may be associated with a specificlocation within a coordinate system, such as the coordinate system(s)described above with reference to FIG. 2. For example, item 402 may beassociated with coordinates (X₁, Z₁), item 404 may be associated withcoordinates (X₁, Z₂), item 406 may be associated with coordinates (X₁,Z₃), item 408 may be associated with coordinates (X₁, Z₄), item 410 maybe associated with coordinates (X₁, Z₅), item 412 may be associated withcoordinates (X₂, Z₅), item 414 may be associated with coordinates (X₃,Z₆), item 416 may be associated with coordinates (X₄, Z₆), item 418 maybe associated with coordinates (X₅, Z₆), item 420 may be associated withcoordinates (X₆, Z₆), item 422 may be associated with coordinates (X₇,Z₆), item 424 may be associated with coordinates (X₈, Z₅), item 426 maybe associated with coordinates (X₈, Z₄), item 428 may be associated withcoordinates (X₈, Z₃), item 430 may be associated with coordinates (X₈,Z₂), and item 432 may be associated with coordinates (X₈, Z₁). Thecoordinates associated with each of the plurality of items 402-432 maybe stored in a database (e.g., one of the databases 130 of FIG. 1 and/ora database of the AGV, such as a database of the navigation module).

In addition to assigning coordinates to the locations associated withitems, coordinates may be associated with one or more docking stationswhere AGVs of embodiments may be stationed when not retrieving items,For example, in FIG. 4, docking stations 440A, 442A, 444A areillustrated. Docking station 440A may be associated with AGV 440,docking station 442A may be associated with AGV 442, and docking station444A may be associated with AGV 444. The docking, stations 440A, 442A,444A may include infrastructure facilitating recharging of the one ormore batteries of the corresponding AGVs 440, 442,444,

Referring to FIG. 5, a block diagram illustrating navigation of an AGVduring item retrieval in accordance with embodiments of the presentdisclosure is shown, hr the example illustrated in FIG. 5, the AGV 440of FIG. 4 is shown navigating through an area to retrieve one or moreparticular items from among the plurality of items 402-432 of FIG. 4.The AGV 440 may initiate retrieval of the items in response to receivinginformation from one or more external devices or systems, such as one ofthe servers 120 of FIG. 1 and/or the user device(s) 150 of FIG. 1, asdescribed above, Upon receiving the information indicating a request toretrieve items, the AGV 440 may process the retrieved information toidentify the particular items to be retrieved and determine locations ofthe items within the coordinate system. It is noted that the locationsdetermined for the items may be relative locations or absolutelocations. When relative locations are utilized, the AGV 440 maydetermine a location within the coordinate system that is proximate thecorresponding item, where the location may be determined “proximate” tothe corresponding item when the location is within a threshold distanceof the item location. As an example, the threshold distance may beapproximately 2-3 feet such that a user can easily retrieve the item andplace it in a particular bin of the AGV 440. When absolute locations areutilized, the AGV 440 may determine a location that is directly in frontof the location of the corresponding item (e.g., the AGV 440 is alignedwith the item in a particular axis of the coordinate system, such as an“X” axis or a “Z” axis).

As illustrated in FIG. 5, the items to be retrieved may include items402, 416, and 428. As explained above with reference to FIG. 4, item 402may be associated with a location (X₁, Z₁), item 416 may be associatedwith a location (X₄, Z₆), and item 428 may be associated with a location(X₈, Z₃). Based on identifying, the items to be retrieved and theircorresponding locations, the AGV 440 (e.g., the navigation module 258)may determine a route or path of travel that the AGV 440 will traverseduring retrieval of the items 402, 416, 428. In the example illustratedin. FIG. 5, the AGV 140 may determine a first waypoint havingcoordinates (X_(A), Z_(B)) where the AGV 440 may stop to retrieve theitem 402, a second waypoint having coordinates (X_(C), Z_(D)) where theAGV 440 may stop to retrieve the item 416, and waypoint havingcoordinates (X_(E), Z_(F)) where the AGV 440 may stop to retrieve theitem 428. If absolute locations are utilized, the first waypoint may bealigned with the coordinates of the location of the item 402 in the “Z”axis (e.g., X_(A), Z₁), the second waypoint may be aligned with thecoordinates of the location of the item 416 in the “X” axis (e.g., X₄,Z_(D)), and the third waypoint may be aligned with the coordinates ofthe location of the item 428 in the “Z” axis (e.g., X_(E), Z₃ 1. Ifrelative locations are utilized the first, second, and third waypointsmay be locations that are within a threshold distance of thecorresponding items but may not necessarily be aligned with the itemlocations in a particular axis.

Having determined the waypoints for retrieval of the items, the AGV 440may calculate a route for retrieving the items, In an aspect, the routemay be determined to minimize the distance traveled during retrieval ofthe items. To illustrate, assume the starting position of the AGV 440 isshown in FIG. 5 and as shown at time (t) instance t=0 at least three ofthe bins of the AGV 440 are empty, as indicated at 510. The determinedroute follows the path 502 until the first waypoint (X_(A), Z_(B)) isreached, At time t=1, the first item 402 is placed in the first bin andthe other two bins remain empty. The AGV 440 then navigates along path504 until the second waypoint (X_(C), Z_(D)) is reached, At time t=2,the second item 414 is placed in the second bin and the other bin remainempty. The AGV 440 then navigates along path 506 until the thirdwaypoint (X_(E), Z_(F)) is reached. At time t=3, the third item 428 isplaced in the third bin and all items to be retrieved have been placedin bins on the AGV 440. Upon the final item being placed into the thirdbin, the AGV 440 may travel along path 508 to a final waypoint where theitems are delivered (e.g, to a production facility, an assembly station,and the like). As can be appreciated, starting from the begginglocation, the route traversed by the AGV 440 is minimized as compared toother possible routes, such as relieving item 428 first, then item 402second, and then item 416 last.

In an aspect, servers (e.g., one of the servers 120 of FIG. 1) maydetermine the particular AGV to assign for a particular parts retrievalbased on various characteristics of the available AGVs, such as alocation of the AGVs relative to the items to be retrieved, theconfiguration of the bins for each AGV (e.g., do the available AGVs havethe correct quantity and/or size of bins needed to retrieve theparticular items requested, do the AGVs have sufficient power to travela route and retrieve all of the items, etc.). Additionally, there may bemultiple storage locations from which the items are available forretrieval. En such instances, an interplant procurement process may beexecuted to select a particular facility from which the items will beretrieved. The interplant procurement process may be configured tooptimize the selection of a facility that will be suitable to procurethe items from in terms of cost, time, distance, availability (e.g., areall of the items on hand or are any of them out of stock), and capacity.The interplant procurement process may utilize machine leaningalgorithms and a rule engine to evaluate facility and AGA/selection, Asan example, a K-Nearest Neighbor (KNN) algorithm may be used to identifythe suitable facility for procurement of the items.

The KNN algorithm may be used for both classification and regressionpredictive problems and may interpret the situation and decide a courseof action, which enables low calculation times to be realized. Toillustrate, the KNN interplant procurement processing rosy be performedon the basis of minimum distance from the input instance to trainingsamples. When there is a shortage in stock for an item due to unforeseenrequirements coming in, the KNN algorithm may be initiated to executethe interplant procurement process to identify a suitable facility forprocurement of the items by the role engine. The core algorithm for KNNalgorithm of the rule engine may be configured to analyze the variousfacilities based on the facility capabilities and choose an optimalfacility, such as a facility that has all items of interest available,is capable of using the items to manufacture or assembly the orderedproduct(s), have available production/manufacturing capacity to completethe manufacturing or assembly process in a required amount of time, andthe like. As another example, if a particular facility is overloaded(e.g., demand exceeds capacity), the rules engine may utilize the KNNprocess to identify alternative locations or facilities that are notoverloaded and move the production process itself from the initialfacility to a different facility that has the capability and capacity tohandle the production process.

The KNN algorithm may receive or be provided (e.g., by the rules engine)with a set of training samples, which may include data and metricsassociated with the available options. Such training samples may includeinformation regarding the number of available manufacturing or assemblyfacilities, the production capabilities of each facility, inventory dataassociated with each facility, load information for each facility,location information for each facility, and other information. The rulesengine may then classify the set of sample data into groups based on aset of parameters. Exemplary parameters that may be used by the rulesengine(s) may include: available capacity, plants that have thecapability (e.g., infrastructure, inventory, capacity or availability,etc.) to perform the manufacturing or assembly operations, and distance.Once the classification process has been completed, the rules engine mayperform regression testing to identify which facility which is the mostsuitable plant based on the requirements under consideration, such as acurrent order or set of orders to be fulfilled,

Referring to FIG. 6, block diagrams illustrating aspects of coordinatesystem functionality in accordance with embodiments of the presentdisclosure are shown. In FIG. 6, a first coordinate system 610 is shown.The first coordinate system 610 includes a virtual coordinate system inwhich grid floor mapping (GFM) techniques are utilized to establish avirtual coordinate system configured to facilitate navigation of afacility, as described above with reference to FIGS. 4 and 5, forexample. It is noted that the virtualized coordinate system illustratedat 610 may be advantageous as compared to conventional GFM techniquesthat required a grid to be physically painted on a floor of a facility.Further, it is noted that the ability to control the distance traveledby AG Vs using stepper motor-based navigation technique, as describedabove, may further contribute to the advantageous nature of the GFMapproach disclosed herein, such as by not requiring modifications to thefacility itself (e.g., the floor of the facility does not need to bepainted, etc.).

Additionally, FIG. 6 illustrates a second coordinate system 620, whichincludes a plurality of beacons 621-628. Each of the beacons 621-628 maybe associated with fixed locations within the coordinate system 620 andmay he configured to generate signals that may be detected by an AGV.The AGV may use the signals received from the beacons to determine thelocation of the AGV within the coordinate system 620, such as by usingtime difference of arrival (TDA) techniques to triangulate the positionof the AM/within the second coordinate system 620. In an aspect, thebeacons 621-628 may include access points or some other form of wirelesscommunication devices configured to generate signals that may be usedfor triangulating the position of the AGV within the coordinate system620.

A third coordinate system 630 is also shown in FIG. 6, in the thirdcoordinate system storage locations for each of the plurality of items402-432 are configured with indicia 631-640, such as letters, images,barcodes, numbers, alpha-numeric identifiers, or the like. The AGVs maybe configured to traverse the facility floor and utilize the opticalsensors to identify particular items within the facility, such as bystoring information that maps particular indicia disposed in proximityto particular items. The AGV may traverse the facility and utilize theAGVs optical sensors (e.g., a camera) to recognize nearby indicia andthen calculate further navigational steps or operations based on thedetected indicia. It is noted that the different types of coordinatesystems illustrated in FIG. 6 have been provided for purposes ofillustration, rather than by way of limitation and that other types ofcoordinate systems may also be utilized in accordance with aspects ofthe present disclosure.

It is noted that the layouts of the shelves or storage infrastructurewhere the items 410-432 are stored., as depicted in FIGS. 4 and 5, aswell as the exemplary coordinate systems 610, 620, 630 have beenprovided for purposes of illustration rather than by way of limitationand that coordinate systems of embodiments may be utilized with othertypes of storage infrastructure layouts. For example, a fourthcoordinate system 650 is shown and includes shelves 652, 654, 656, 658,660, 662 arranged into rows and columns. Each of the shelves 652, 654,656, 658, 660, 662 may be single sided or double sided shelvesconfigured to store items for subsequent retrieval according to thetechniques disclosed herein. As described above, the items stored on theshelves 652, 654, 656, 658, 650, 662 may each be associated with aparticular location within the fourth coordinate system 650 and thelocations of the items may be utilized to determine one or morewaypoints for retrieving items stored on the shelves 652, 654, 656, 658,660, 662 using the techniques described above with reference to FIGS. 4and 5. The layout illustrated with respect to the coordinate system 650may be more representative of large warehouse-type environments to whichthe concepts disclosed herein may readily be applied. It is noted thatthe coordinate system and the devices utilizing the coordinate system tofacilitate retrieval of items may recognize that portions of thecoordinate system are not suitable for travel by the AGV. For example,regions within the coordinate system occupied by the storageinfrastructure, such as the shelves 652, 654, 656, 658, 660, 662, may bedesignated or understood to be non-traversable by the AGV anddetermination of waypoints may be configured to route around the areasoccupied by the storage infrastructure.

Referring to FIG. 7, a block diagram illustrating different AGV binconfigurations in accordance with embodiments of the present disclosureis shown, In FIG. 7, a first bin configuration 710 illustrates an AGVhaving four bins 712-718; a second bin configuration 720 illustrates anAGV having one bin 722; a third bin configuration 730 illustrates an AGVhaving three bins 732-736; and a fourth bin configuration 740illustrates an. AGV having two bins 742, 744. As described above, theparticular bins configured for each. AGV may be adjustable depending onthe particular demand present at a facility where the AGVS are beingoperated, For example, the first bin configuration illustrated at 710includes four equally or approximately (e.g., +/− a determined distance)equal sized bins, the bin configuration illustrated by bin configuration720 include a single large bin, and the third bin configuration 730includes two bins 734, 736 similar in size to the bins 712, 714, 716,and 718 illustrated in the first bin configuration 710 and also includesan elongated bin 732 that is larger in size than the bins 734, 736.Similarly, the fourth bin configuration includes two elongated bins 742,744. The ability to customize the particular bins for which an AGV isconfigured may enable. certain AGVs to be operated more efficiently,such as to include. man smaller bins when items to be retrieved by theAGV are small and larger bins when larger items are to be retrieved.

In an aspect, one or more of the bins configured for a particular AGVmay include optical sensors (e.g., LED lights, etc.) configured toassociate retrieved items with a particular bin secured to the bininterface of the AGV. For example, as shown in the third binconfiguration 730, optical sensors 732A, 734A, 736A may be associatedwith each bin. When a particular item corresponding to one of the binsof the AGV is to be retrieved (e.g., the AGV is proximate to or near thenext item to be retrieved, the optical sensor corresponding to the itemmay be activated (e.g., lit up) in order to indicate into which bin theretrieved item should be placed. For example, in FIG. 7, optical sensor734A is “lit up” to indicate that the AGV is near the item that is to beplaced into the bin 734. When the item is placed into bin 734, a weightsensor or other technique may be utilized to verify the correct item(and/or correct quantity of items) has been placed into the bin 734, ifthe AGV determined that the correct item(s) has been placed in bin 734,the optical sensor may be deactivated. If the wrong item has been placedinto bin 734 (e.g., based on weight data or some other form offeedback), the optical sensor may begin to flash or some other type ofalert may be generated, such as a sound being played or a notification(e.g., a short messaging service (SMS) message may be transmitted to theuser retrieving the items). Providing the optical sensors associatedwith each bin may ensure that retrieved items are placed into thecorrect bins, which may ensure that the items are retrieved correctlyand may minimize the amount of time required to retrieve the items.

Referring to FIG. 9, a block diagram illustrating aspects of utilizing a3 dimensional coordinate system in accordance with embodiments of thepresent disclosure is shown. As briefly mentioned above, aspects of thepresent disclosure may be configured to utilize coordinate systems tonavigate AGVs into proximity with items to be retrieved. While theexamples described above with reference to FIGS. 4 and 5 haveillustrated concepts related to 2 dimensional coordinate systems,embodiments are not limited to 2 dimensional coordinate systems. In FIG.9, a plurality of items 901-944 are illustrated as being orientedvertically, such as may occur when items are stored on shelves within afacility. As described above, the AGV may navigate to the location ofthe item of interest (e.g., the next item to be retrieved) based on acoordinate location of the item of interest and one or more determinedwaypoints. Once the AGV arrives at the item of interest (e.g., usingrelative or absolute locations), the AGVs may initiate operations toidentify the item of interest in 3 dimensional space to the user (e.g.,the individual that will retrieve the item of interest from its storagelocation and load it into the appropriate bin of the AGV, as describedabove, In an aspect, AGVs may initially move according to just thecoordinates, However, over time the AGVs may utilize machine learningtechniques to identify the series of waypoints used to retrieve items.For example, as explained above the AGV is may include sensors that maybe used to detect obstacles along a determined path of travel. If an AGVencounters such obstacles multiple times, the navigation module of theAGV may update information associated with the coordinate system toindicate the presence of the obstacle. The updated coordinate systeminformation may be subsequently used by the AGVs navigation moduledetermine routes that are not obstructed by the obstacle, which improvesthe route planning capabilities of the AGV and ensures that optimal(e.g., shortest distance, etc.) paths are used to retrieve items.

In an example, the AGV may utilize an optical sensor, Such as a laser,to identify the item of interests to the user, such as by pointing alaser at the item of interest. Alternatively, the AGV may transmit amessage to a server (e.g., one of the servers 130 of FIG. to indicatethat the AGV has arrived at the location associated with the item ofinterest and the server may activate one or more optical sensors thatindicate the storage location for the item of interest. For example, andreferring to FIG. 10, a block diagram illustrating aspects ofidentifying an item of interest in accordance with embodiments of thepresent disclosure is shown. In FIG. 10, storage locations associatedwith a plurality of items 1010, 1020, 1030, 1040 are shown. Each of thestorage locations may include an optical sensor, illustrated in FIG. 10as optical sensors 1012, 1022, 1032, 1042. The optical sensors 1012,1022, 1032, 1042 may include LEDs that may be selectively activated (or“lit up”) to indicate the next item of interest. For example, as shownin the bottom of FIG. 10, optical sensor 1012 may be activated toindicate that one or more items of interest are housed in the storagelocation associated with the activated optical sensor. Once the items)of interest is retrieved from the storage location and loaded into theappropriate bin of the AGV, the optical sensor may he deactivated andthe AGV may traverse to the next waypoint along its travel route.

Referring back to FIG. 9, suppose that the item of interest correspondsto item 921, As described with reference to FIG. 10, an optical sensorassociated with the storage location of item 921 may be activated,thereby allowing rapid identification of the item of interest in 3dimensional space. In an aspect, when the item is correctly loaded ontothe AGV, the optical sensor associated with the storage location of theitem 921 may be deactivated (e.g., turned off). Alternatively,activation of the optical sensor may be configured to last for apredetermined duration (e.g., 10 seconds, 20 seconds, or some otherdefined period of time) after which the optical sensor is turned off.

Referring to FIG. 11, a flow diagram of an exemplary process forretrieving items from a facility using AGVs in accordance withembodiments of the present disclosure is shown as a process 1100. It isnoted that aspects of the process 1100 may be performed by a system,such as the system 100 illustrated and described with reference to FIG.1, Additionally, aspects of the process 1100 may be facilitated, atleast in part, by AGVs configured to perform the operations describedabove with reference to FIGS. 2 and 4-10.

At step 1102, a customer device (e.g., the customer device 110 ofFIG. 1) may access the relevant system, such as by accessing a webportal via an application, which may be a web browser-based applicationor a standalone application installed on the customer device, Afterauthenticating the customer via the application, the customer may beauthorized to configure an order, such as by specifying a final productto be purchased or produced. Once configured via the application, orderdata 1110 may be transmitted to an enterprise resource planning (ERP)server 1104, which may be one of the servers 130 illustrated in FIG. 1,Upon receiving the order data 1110, the ERP server 1104 may beconfigured to distribute the order data to a warehouse server 1106 asproduction order data 1120. In an aspect, the warehouse server 1106 towhich the production order data 1120 is distributed may be determinedusing the KNN algorithm described above. For example, a particularwarehouse having the appropriate production capacity and itemavailability may be determined from among a plurality of availablewarehouse facilities and after identifying the particular warehouse, theproduction order data 1120 may be transmitted to the correspondingwarehouse server 1106.

The warehouse server 1106 may be an additional one of the servers 130 ofFIG. 1. Upon receiving the production order data 1120, the warehouseserver 1106 may analyze the production order data to generate a tasklist. The task list may identify the item(s) to be retrieved, the bininto which the item(s) is to he placed, and other information (e.g., atask identifier, etc). The task list may be transmitted to theelectronic device 300 as task details data 1130 and may be transmittedto the AGV 200 as item detail data 1140. The information included in thetask details data 1130 may be presented at the user device 300 of FIG.3, as described above with reference to FIGS. 12A-12E. The instructions322 stored at the memory 320 of the electronic device 300 may includeinstructions to translate the task details data 1130 into one or moreinterface elements presented to the user, such as the interface elementsdescribed above with reference to the display regions corresponding todifferent items described above with reference to FIGS. 12A-12E.Alternatively or additionally, the memory 320 of the electronic device300 may store one or more templates that may be populated withinformation from the task details data 1130.

The item detail data 1140 provided to the AGV 200 may includeinformation that associates particular items with particular bins of theAGV 200, For example, each item may be associated with a particular sizeof bin depending on the size of the item and the quantity of the item tobe retrieved. As described above, sensors of the AGV 200 may be utilizedto verify (e.g., by weight) that the correct item or quantity of itemshave been placed within the correct bin, in an aspect, the particularAGV 200 to which the item detail data is transmitted may be selected bythe warehouse server 1106. For example, after generating the task listbased on the production order data 1120, the warehouse server 1106 maydetermine a current status of one or more AGVs at a selected warehousefacility, where the current status indicates whether the AGV iscurrently being used to retrieve items or is available for use inretrieving the item(s) indicated in the production order data 1120,whether the AGV has the correct bin configuration (or requiresreconfiguration to have the correct number and size of bins), and thelike.

Once the task details information 1130 and the item detail data 1140have been provided to the electronic device 300 and the AGV 200,respectively, the item(s) may be retrieved using the processes describedabove with reference to FIGS. 2-10. For example, the AGV 200 maydetermine a route for retrieving the item(s) from the facility and maynavigate to one or more waypoints to retrieve the items. The AGV 200 maystop at each waypoint here an item is to be retrieved and the userassociated with the electronic device 300 may obtain the itemcorresponding to the current waypoint and place the item in the correctbin, which may be indicated by one or more optical devices disposed onthe bin interface of the AGV, as described above with reference to FIG.As the items are retrieved, the user may interact with the graphicaluser interface displayed at the display screen 1202 of the electronicdevice 300 to indicate whether items have been success ally retrievedand feedback based on the user interaction with the graphical userinterface, as well as feedback generated by the AGV 200, may hetransmitted to one or more remote servers, such as the warehouse server1106 to indicate the successful retrieval of the items, Once all itemshave been successfully retrieved, the AGV 200 may navigate to adestination waypoint, where the items may be unloaded from the bins foruse in further processes (e.g., manufacturing or assembly processes).

As the feedback is received at the warehouse server .1106, one or moredatabases may be updated. For example, an inventory database may beupdated to reflect that the retrieved items have been consumed andinventory quantities on hand fur the retrieved items may be reducedbased on the particular quantities of the item(s) retrieved. Asexplained above, by using feedback from both the electronic device 300and the AGV 200, erroneous item retrievals may he quickly identified andcorrected, thereby improving the accuracy of records of the inventorydatabase. Further, by ensuring that the correct items are retrieved,delays that may otherwise occur if the incorrect item(s) is retrieved orthe incorrect quantity of the item(s) is retrieved may also beeliminated, such as delays in completing the processes that utilize theretrieved parts.

Referring to FIG. 13, a flow diagram of an exemplary method forretrieving items from an item and storage infrastructure in accordancewith embodiments of the present disclosure is shown as a method 1300. Inaspects, the method 1300 may be performed one or more processors, suchas one or more processors of the system components illustrated inFIG. 1. Steps of the method 1300 may be stored as instructions that,when executed by the one or more processors, cause the one or moreprocessors to perform operations to retrieve items in accordance withthe concepts described in the present disclosure.

At step 1310, the method 1300 includes receiving, by a one or moreprocessors, demand information associated with demand for one or moreitems utilized by manufacturing process. As explained above withreference to FIGS. 1 and 11, the demand information may be determinedbased on information received by an ERP server (e.g., one of the servers120 of FIG. 1 and the ERP server 1104 of FIG. 11) from one or morecustomer devices (e.g., the one or more customer devices 110 of FIG. 1and the customer device(s) 1106 of FIG. 11). The demand information maybe based on information included in an order received from the customerdevice(s), or may be based on historic demand information, such ashistoric demand information stored in one of the one or more databases130 of FIG. 1.

At step 1320, the method 1300 includes executing, by the one or moreprocessors, a rules engine against the demand information to identifyinfrastructure from which at least portion of the items utilized by themanufacturing process are to be retrieved. As explained above, the rulesengine may utilize a KNN algorithm to select the item and storageinfrastructure that is to be used to retrieve the items (or a portionthereof) and may also be utilized to select an AGV that is to be used toretrieve the items. The item and storage infrastructure may be selectedbased on whether the item and storage infrastructure hat a currentquantity of at least the portion of the items on hand that is sufficientto meet the demand. As described above, the KNN algorithm may alsoevaluate the available AGVs at the selected item and storageinfrastructure to identify an AGV that has the appropriate number ofbins, bin sizes, availability, etc, to retrieve the items.

At step 1330, the method 1300 includes transmitting, by the one or moreprocessors, item detail data to the AGV. As described above withreference to FIG. 11, the item detail data may identify one or moreitems to be retrieved, a quantity to be retrieved for each of the one ormore items, and information identifying a location of each of the one ormore items within a coordinate system. Alternatively, the location ofeach of the one or more items may be determined autonomously by the AGVor by accessing a remote database (e.g., one of the databases 130 ofFIG. 1) to obtain information associated with the locations of the oneor more items, as described above with reference to FIGS. 2, 4, and 5.The coordinate system may be calibrated to a distance corresponding toan incremental movement of traction components of the AGV when thetraction components of the AGV are driven by one or more motors of theAGA. For example, as described above with reference to FIGS. 2 and 4,the traction components of the AGV may include tires and/or treadsdriven by a stepper motor and the coordinate system may be calibrated toa distance traveled by the AGV in response to a predetermined number ofsteps of the stepper motor. In an aspect, other types of coordinatesystem that are not specifically calibrated to incremental movements ofthe traction components may be utilized to navigate the AGV, such as theexemplary techniques described above with reference to FIG. 6.

At step 1340, the method 1300 includes receiving, by the one or moreprocessors, information that indicates the AGV is at a first waypointcorresponding to a particular item of the one or more items and at step1350, activating, by the one or more processors, an optical sensorcorresponding to the particular item of the one or more items toidentify the particular item for retrieval, As described above withreference to FIGS. 4, 5, 9, and 10, storage locations associated withitems stored in the item and storage infrastructure may include opticalsensors that may be activated to identify (e.g., to a user) theparticular location of an item that is to be retrieved. This ensuresthat the user retrieves the correct item or at least minimizes, the riskthat the user retrieves the incorrect item. As described above withreference to FIG. 7, the AGV may also be configured to activate anoptical sensor corresponding to a particular bin of the AGV while at thefirst waypoint. The optical sensor that is activated may correspond to aparticular bin of the AGV and may identify a location where theparticular item is to be placed upon retrieval from the item and storageinfrastructure. It is noted that in alternative embodiments, step 1340may be omitted and/or replaced with automated retrieval of the itemassociated with the first waypoint by item retrieval components of theAGV, as described above with reference to FIG. 2.

At step 1360, the method 1300 includes receiving, by the one or moreprocessors, validation information associated with the particular itemfrom the AGV and at step 1370, validating, by the one or moreprocessors, that the particular item has correctly been retrieved basedon validation information. As described above, the AGV may include aSensor configured to determine a weight of the particular item once theparticular item has been placed in the bin of the AGV. The AGV may beconfigured to transmit the weight of the particular item to a server asvalidation information and the server may perform the validating basedon whether the weight indicated in the validation information matches aweight of the particular item. If the particular item has not beencorrectly retrieved, one or more alerts may be generated and transmittedto a user device to alert to the user that the item has not beencorrectly retrieved. The alert may be an SMS message, an auditorymessage, and the like. Additionally or alternatively, the AGA/mayreceive an alert that triggers flashing of the optical sensor associatedwith the bin into which the particular item has been placed or someother form of alert provided by the AGV, such as an auditory alert.

At step 1380, the method 1300 includes updating, by the one or moreprocessors, an inventory database to reflect a reduced quantity of theparticular item is available when the validating indicates theparticular item has correctly been retrieved. As explained above, byproviding validation for items retrieved according to the method 1300,inventory databases may be maintained in a state that accuratelyreflects, in real-time, current quantities of items available forconsumption during manufacturing/assembly processes. Additionally, thefeedback techniques provided by the method 1300 ensure that user errorswith respect to item retrieval are minimized or completely eliminated,which reduces the chance that a manufacturing process is halted due toincorrect items being provided to the manufacturing/assembly area,Further, by utilizing the AGV to transport items from the item andstorage infrastructure to the manufacturing/assembly area, itemretrieval processes may be performed more efficiently, both in terms ofcost and availability (e.g., AGVs may operate for prolonged periods oftime with minimal or no interaction with users).

As explained above with respect to FIGS. 11 and 12A-12E, the method 1300may also include transmitting, by the processor, task detail data to auser device. The task detail data may be configured to display one ormore tasks to be completed by a user associated with the user deviceduring retrieval of at least the portion of the items on a displayscreen of the user device, such as the exemplary tasks illustrated inFIGS. 12A-12E. The one or more tasks to be completed may be displayed asone or more interactive elements within a graphical user interface thatprovides visual information associated with each of the one or moretasks and one or more interactive elements configured to solicitinput(s) from the user regarding completion of each of the one or moretasks. Additionally, each of the one or more tasks may be displayedwithin the graphical user interface according to a color schemeconfigured to apply different colors to different tasks of the one ormore tasks to indicate a task completion state.

In an aspect, the method 1300 may also include calculating, by the oneor more processors, a series of waypoints associated with retrieval of,at least the portion of the one or more items. The series of waypointsmay identify one or more locations within the coordinate system wherethe MTN is to navigate during retrieval of at least the portion of theone or more items and a final destination where at least the portion ofthe one or more items are to be delivered by the AGV after all itemsincluded in at least the portion of the one or more items have beencorrectly retrieved. Alternatively or additionally, the AGV may includea navigation module configured to calculate the series of waypoints. Inaspects, the series of waypoints may be calculated by the AGV based onthe item detail data (e.g., the item detail data 1140 of FIG. 11), suchas by determining coordinates associated with the item(s) specified inthe item detail data within the coordinate system and plotting a routeto retrieve the items based on the determined coordinates. Whereobstacles have been previously identified by the AGV, informationassociated with those obstacles may be taken into account whencalculating the series of waypoints, such as to determine a route thatbypasses any known obstacles, as described above. Alternatively, theseries of waypoints may be calculated by a server (e.g., the one or moreservers 120 of FIG. 1, the ERP server 1104 of FIG. 11 the warehouseserver 1106 of FIG. 11) and included in the item detail data received bythe AGV. When the series of waypoints is received by the AGV from aremote server, the navigation module of the AGV may determine an orderin which each of the waypoints is visited and a route for navigating toeach of the waypoints. In some aspects, the routing between waypointsmay also he specified by the remote server and the AGV may adjust thespecified route based on obstacles encountered during movement along theroute.

As described above, operations of the method 1300 may facilitate fasterretrieval of items for use in manufacturing or assembly processes. Forexample, providing real-time feedback to users to indicate the locationof items to be retrieved (or retrieving the items automatically) mayenable rapid identification and retrieval of items, allowing those itemsto be collected and delivered to manufacturing processes more rapidly.For user-aided retrieval processes, the disclosed embodiments providereal-time analysis and verification processes that ensure items arecorrectly retrieved and generate alerts when incorrect items areretrieved or are loaded onto the AGV incorrectly. Further, the real-timeanalysis and verification processes may be utilized to provide feedbackto inventory management systems to enable real-time tracking ofinventory in an automated and accurate manner that eliminates the needto perform manual audits of inventory and avoids delays that may occurin a manufacturing process if inventory levels inaccurately reflectavailability of items within an item and storage infrastructure. It isnoted that the method 1300 provides additional advantages over priorprocesses, such as the benefits described above with reference to FIGS.1-12, which are not repeated here for simplicity of the disclosure.

Although the embodiments of the present disclosure and their advantageshave been described in detail, it should be understood that variouschanges, substitutions and alterations can be made herein withoutdeparting from the spirit and scope of the disclosure as defined by theappended claims. Moreover, the scope of the present application is notintended to be limited to the particular embodiments of the process,machine, manufacture, composition of matter, means, methods and stepsdescribed in the specification. As one of ordinary skill in the art willreadily appreciate from the present disclosure, processes, machines,manufacture, compositions of matter, means, methods, or steps, presentlyexisting or later to be developed that perform substantially the samefunction or achieve substantially the same result as the correspondingembodiments described herein may be utilized according to the presentdisclosure, Accordingly, the appended claims are intended to includewithin their scope such processes. machines, manufacture, compositionsof matter, means, methods, or steps,

What is claimed:
 1. A method comprising: receiving, by a processor,demand information, the demand information associated with demand forone or more items utilized by a manufacturing process; executing, by theprocessor, a rules engine against the demand information, the executingconfigured to identify infrastructure from which at least portion of theitems utilized by the manufacturing process is to be retrieved, whereinthe infrastructure comprises at least ore automated guided vehicle (AGV)and an item and storage infrastructure having a current quantity of atleast the portion of the items on hand to meet the demand; transmitting,h the processor, item detail data to the AGV, the item detail dataidentifying: one or more items corresponding to at least the portion ofthe items, a quantity to be retrieved for each of the one or more items,and information identifying a location of each of the one or more itemswithin a coordinate system, wherein the coordinate system is calibratedto a distance corresponding to an incremental movement of tractioncomponents of the AGV when the traction components of the AGV are drivenby one or more motors of the AGV; receiving, by the processor,information that indicates the AGV is at a first waypoint, the firstwaypoint corresponding to a particular item of the one or more items;activating, by the processor, an optical sensor, the optical sensorcorresponding to the particular item of the one or more items, whereinactivation of the optical sensor is configured to identify theparticular item for retrieval; receiving, by the processor, validationinformation associated with the p:articular item, the validationinformation received from the AGV; validating, by the processor, thatthe particular item has correctly been retrieved based on validationinformation; and updating, by the processor, an inventory database,updating configured to reflect that a reduced quantity of the particularitem is available when the validating indicates the particular item hascorrectly been retrieved.
 2. The method of claim 1, farther comprisingtransmitting, by the processor, task detail data to a user device, thetask detail data is configured to display one o more tasks to becompleted by a user associated with the user device during retrieval ofat least the portion of the items on a display screen of the userdevice.
 3. The method of claim 2, wherein the one or more tasks to hecompleted are displayed as one or more interactive elements within agraphical user interface, the graphical user interface providing: visualinformation associated with each of the one or more tasks, and aninteractive element configured to solicit input from the user regardingcompletion of each of the one or more tasks.
 4. The method of claim 3,wherein each of the one or more tasks are displayed according to a colorscheme, the color scheme applies different colors to different tasks ofthe one or more tasks to indicate a task completion state.
 5. The methodof claim 1, wherein traction components of the AGV are driven by astepper motor, wherein the coordinate system is calibrated to a distancetraveled by the AGV in response to a predetermined number of steps ofthe stepper motor.
 6. The method of claim 1, wherein the AGV isconfigured to activate an optical sensor corresponding to a particularbin of the AGS at the first waypoint, the optical sensor correspondingto the particular bin of the AGV identifying a location where theparticular item is to be placed upon retrieval from the item and storageinfrastructure.
 7. The method of claim 6, wherein the AGV comprises asensor configured to determine a weight of the particular item placed inthe particular bin of the AGV, the validation information including theweight, and wherein the validating is configured to determine theparticular item has correctly been retrieved based on whether the weightindicated in the validation information matches a weight of theparticular item.
 8. The method of claim 1, further comprisinggenerating. and transmitting an alert to a user device in response tothe validating, the alert indicating that the particular item has notbeen correctly retrieved.
 9. The method of claim 1, further comprisingcalculating a series of waypoints associated with retrieval of at leastthe portion of the one or more items, the series of waypointsidentifying one or more locations within the coordinate system where theAGV is to navigate during retrieval of at least the portion of the oneor more items and a final destination where at least the portion of theone or more items are to be delivered by the AGV after all itemsincluded in at least the portion of the one or more items have beencorrectly retrieved.
 10. A non-transitory computer-readable storagemedium storing instructions that, when executed by one or moreprocessors, cause the one or more processors to perform operationscomprising; receiving demand information, the demand associated withdemand for one or more items utilized by a manufacturing process;executing a rules engine against the demand information, the executingconfigured to identify infrastructure from which at least a portion ofthe items utilized by the manufacturing process is to be retrieved,wherein the infrastructure comprises at least one automated guidedvehicle (AGV) and item and storage infrastructure having a currentquantity of at least the portion of the items on hand to meet thedemand; transmitting item detail data to the ACW, the item detail dataidentifying: one or more items corresponding to at least the portion ofthe items, a quantity to be retrieved for each of the one or more items,and information identifying a location of each of the one or more itemswithin a coordinate system, wherein the coordinate system is calibratedto a distance corresponding to an increment& movement of tractioncomponents of the AGV when the traction components of the AGV are drivenby one or more motors of the AGV; receiving information that indicatesthe ACT is at a first waypoint, the first waypoint corresponding to aparticular item of the one or more items; activating an optical sensor,the optical sensor corresponding to the particular item of the one ormore items, wherein activation of the optical sensor is configured toidentify the particular item for retrieval; receiving validationinformation associated with the particular item, the validationinformation received from the AGV; validating that the particular itemhas correctly been retrieved based on the validation information; andupdating an inventory database, the updating configured to reflect areduced quantity of the particular item is available when the validatingindicates the particular item has correctly been retrieved.
 11. Thenon-transitory computer-readable storage medium of claim 10, theoperations further comprising transmitting task detail data to a userdevice, the task detail data is configured. to display one or more tasksto be completed by a user associated with the user device duringretrieval of at least the portion of the items on a display screen ofthe user device.
 12. The non-transitory computer-readable storage mediumof claim 11, wherein the one or more tasks to he completed are displayedas one or more interactive elements within. a graphical user interface,the graphical user interface providing: visual information associatedwith each of he one or more tasks, and an interactive element configuredto solicit input from the user regarding completion of each of the oneor more tasks.
 13. The non-transitory computer-readable storage mediumof claim 12, wherein each of the one or more tasks are displayedaccording to a color scheme, the color scheme applies different colorsto different tasks of the one or more tasks to indicate a taskcompletion state.
 14. The non-transitory computer-readable storagemedium of claim 10, wherein traction components of the AGV are driven bya stepper motor, wherein the coordinate system is calibrated to adistance traveled by the AGV in response to a predetermined number ofsteps of the stepper motor.
 15. The non-transitory computer-readablestorage medium of claim 10, wherein the AGV is configured to activate anoptical sensor corresponding to a particular bin of the AGV at the firstwaypoint, the optical sensor corresponding to the particular bin of theAGV identifying a location where the particular item is to be placedupon retrieval from the item and storage infrastructure.
 16. Thenon-transitory computer-readable storage medium of claim 15, wherein theAGV comprises a sensor configured to determine a weight of theparticular item placed in the bin of the AGV, the validation informationincluding the weight, and wherein the validating is configured todetermine the particular item has correctly been retrieved based onwhether the weight indicated in the validation information matches aweight of the particular item.
 17. The non-transitory computer-readablestorage medium of claim 10, the operations further comprising generatingand transmitting an alert to a user device in response to the validatingindicating that the particular item has not been correctly retrieved,18. The non-transitory computer-readable storage medium of claim 10, theoperations further comprising: calculating a series of waypointsassociated with retrieval of at least the portion of the one or moreitems the series of waypoints identifying: one or more locations withinthe coordinate system where the AGV is to navigate during retrieval ofat least the portion of the one or more items, and a final destinationwhere at least the portion of the one or more items are to be deliveredby the AGV after all items included in at least the portion of the oneor more items have been correctly retrieved.
 19. A system comprising: anautomated guided vehicle (AGV) comprising: one or more motors; tractioncomponents; and one or more processors; and a memory communicativelycoupled to the one or more processors, wherein the one or moreprocessors are configured to: receive demand information, the demandassociated with demand for one or more items utilized by a manufacturingprocess; execute a rules engine against the demand information, theexecution of the rules engine configured to identify infrastructure fromwhich at least portion of the items utilized by the manufacturingprocess is to be retrieved, the infrastructure comprising at least AGVand an item and storage infrastructure having a current quantity of atleast the portion of the items on hand to meet the demand; transmit itemdetail data to the AGV, the item detail data identifies: one or moreitems corresponding to at least the portion of the items, a quantity tobe retrieved for each of the one or more items, and informationidentifying a location of each of the one or more items within acoordinate system, wherein the coordinate system is calibrated to adistance corresponding to an incremental movement of the tractioncomponents of the AGV when the traction components of the AGV are drivenby the one or more motors; receive information that indicates the AGV isat a first waypoint corresponding to a particular item of the one ormore items; activate an optical sensor, the optical sensor correspondingto the particular item of the one or more items, wherein activation ofthe optical sensor is configured to identify the particular item forretrieval; receive validation information associated with the particularitem, the validation information received from the AGV; validate thatthe particular item has correctly been retrieved based on validationinformation; and update an inventory database stored in the memory, theupdate configured to reflect a reduced quantity of the particular itemis available when the validating indicates the particular item hascorrectly been retrieved,
 20. The system of claim 19, wherein the one ormore processors are configured to transmit task detail data to a userdevice, the task detail data configured to display one or more tasks tobe completed by a user associated with the user device during retrievalof at least the portion of the items on a display screen of the userdevice.